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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
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3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
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Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
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each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 
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Response to Amendment 

1 . Applicant's amendment filed 09/23/2008 has been entered and carefully 
considered. 

The specification has been amended. 
Claims 1-12 have been cancelled. 
Claims 13-20 have been added. 

Reasons for Allowance 

2. Claims 13-20 are allowed. 

The following is a statement of reasons for the indication of allowable subject 
matter: 

The combination as claimed wherein determining at least one location of the at 
least flaw on the surface of the three-dimensional object from the at least one picture 
using design data related to the object, optical imaging properties of the at least one 
optical image-taking device, and a position of the at least one optical image-taking 
device and a position of the object when the at least one picture is taken; determining a 
start path traversable by the marking device from the design data related to the object, 
from position data and from previously- defined, permissible areas of movement of the 
marking device; wherein the at least one optical image-taking device, the object and at 
least one of respective displacement devices for moving the at least one optical image- 
taking device, the object, and the marking device are three-dimensionally calibrated to 
each other (claim 13) is not disclosed, suggested, or made obvious by the prior art of 
record. 
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The combination as claimed wherein said marking controller automatically 
assigns at least one location of at least one of the flaws to at least one of the marking 
heads according to design data for the object, said marking controller controls the 
displacement devices to position said at least one of said marking heads at said at least 
one location of said at least one flaw based on said design data related to the object 
and transmitted position data related to said at least one location of said at least one 
flaw and said marking controller determines a start path for the marking device from 
said design data related to the object, from position data and from previously-defined, 
permissible areas of movement of the marking device (claim 19) is not disclosed, 
suggested, or made obvious by the prior art of record. 

Alders et al (US 6,320,654 B1) discloses a system for detecting selected surface 
defects of a object body shell 2 comprising a sensor system 27, an optical measuring 
device 4, a computer system 5, and a marking system 32. The optical measuring device 
4 comprises a projection device formed by radiation emitters 1 1 , 13, 16, and 19 that 
generate a light tunnel or light curtain 23 that produces a specific grid pattern of lighter 
and darker grid pattern points on a measuring strip 24 on the surface of the body shell 
2. CCD cameras 12, 14, 17 and 20 record the light 25 reflected from the surface from 
the body shell 2 as an image of the grid points at a specific angle and emit a 
corresponding test signal that is transmitted to the computer system 5. Surface defects 
requiring reworking are determined in the computer system 5 using state-of-the-art 
triangulations methods, wherein the computer system recognizes the surface 
unevenness on the basis of the test signal (see column 7, line 52 to column 8, line 62). 
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Kivba (US 5,716,262 ) discloses a defect polishing robot 1 comprising a polishing 
head for eliminating paint surface defects by polishing up to a certain predetermined 
number and a marking head 3 for marking excess paint surface defects for later 
processing. The robot 1 has a robot arm 2 provided at its end with a surface inspection 
apparatus 4 directly secured thereto, and a marking head 3, which is attached to 
another arm 9b of the L-shaped mounting bracket 9. The robot arm 2 is further provided 
at the end with a reversible motor 10 with a vertically oriented center axis of rotation, 
which turns a mounting bracket 9 in both directions through an angle of 90 degrees 
around the center axis of rotation of the motor 1 0. This alternately places the marking 
head 3 or the polishing head 5 in a working position. The surface defect inspection 
apparatus 4 includes an image pick-up device such as a CCD camera 6 and a light 
source 8 mounted within a lamp house or housing 7. The CCD camera 6 takes a picture 
of an illuminated surface of a subject work, such as a painted vehicle body B, on a 
charge coupled device (CCD). In operation, the polishing robot 1 acts to inspection for 
and eliminate paint defects. The surface inspection apparatus 4 picks up an image of a 
circular unit area having a diameter of, for instance, approximately 50 mm of the painted 
surface and processes data representative of the image so as to detect and locate paint 
defects, grade the defects and determine their positions in an X-Y perpendicular 
coordinate system. Based on the position data of these paint defects, the polishing 
robot 1 operates the robot arm 2. 

Larsson et al (US Patent 6,667,800 B1) discloses a method and apparatus for 
measuring and quantifying surface finishing defects, such as defects on polished 
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surfaces, by means of optical registration with subsequent image analysis and 
processing. Figure 1 of Larsson, et al, shows a test surface 2, which is illuminated with 
parallel light from a first spot lighting source 3 and, at the same time, camera 4 records 
a first image of the test surface 2. Thereafter, the first spot lighting source 3 is switched 
off and a second spot lighting source 5, adjacent to and parallel to the first spot lighting 
spot 3, illuminates the test surface 2 and, at the same time, camera 4 records a second 
image of the test surface 2. After that, first and second images are transferred to a 
central unit 7 that includes image analysis functions and control functions. In unit 7, the 
second image is subtracted from the first image (or vice versa) in order to provide a 
difference image. In the difference image, surface defects, such as polishing roses, 
appear with a certain intensity corresponding to the degree of severity of the surface 
defects being analyzed. 

Shimbara (US Patent 5,625,197) discloses a method of determining a time at 
which an image of illuminated surface area is read in for image processing to detect 
surface defects. In the method of Shimbara a painted vehicle body 1 , which is placed on 
a truck 1 1 moving at a specified speed in a lengthwise travel direction A toward an 
inspection station 3. The inspection station 3 comprises work sensors 7 and 13. Work 
sensor 7 detects when the vehicle body 1 is placed in a specific reference position in 
the inspection station 3 and work sensor 13 detects a transverse displacement of the 
vehicle body 1 . Data from these work sensors 7 and 13 are used to determine the 
position and speed of the vehicle body 1 within the inspection station 3 using a 
complicated procedure (column 3, line 61 to column 4, line 21 of Shimbara). In the 
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vehicle manufacturing line, the image pick-up device 9 starts to pick up images of the 
surface of the painted vehicle body 1 after the work sensor 7 detects the painted vehicle 
body 1 and provides a signal (see column 4, line 58, to column 5, line 14). In order to 
pick up images with the image pick-up device 9, a surface light source provides a fixed 
area of illumination incident upon the surface of the vehicle body 1 at a specified 
incident angle so as to illuminate at least a part of the body surface covered within the 
field of view of each image pick-up device 9. Since the vehicle body 1 is transported at a 
constant speed in the travel direction A, the area illumination scans over the entire 
surface of the vehicle body 1 from the front and to the rear end. With this procedure, the 
entire surface of the vehicle body 1 is spatially divided into a plurality of lengthwise 
sections having a lengthwise width corresponding to the scanning interval. Images of 
these sections are read into an image processing unit 12. Shimbara discloses a method 
for handling changes in the width of an illuminated area on a surface that is being 
inspected even though a specified area of illumination is given at which light strikes the 
surface. This change occurs due to unevenness of subject surface. In order to 
determine a scanning interval at which a subject surface is scanned without any 
omission of image reading, the picture elements are transformed into two-valued image 
data and represented by rectangular coordinates along an X-axis a perpendicular Y-axis 
direction. 

However, Alders et al, Kivba, Larsson et al, and Shimbara do not disclose 
wherein determining at least one location of the at least flaw on the surface of the three- 
dimensional object from the at least one picture using design data related to the object, 
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optical imaging properties of the at least one optical image-taking device, and a position 
of the at least one optical image-taking device and a position of the object when the at 
least one picture is taken; determining a start path traversable by the marking device 
from the design data related to the object, from position data and from previously- 
defined, permissible areas of movement of the marking device; wherein the at least one 
optical image-taking device, the object and at least one of respective displacement 
devices for moving the at least one optical image-taking device, the object, and the 
marking device are three-dimensionally calibrated to each other. Alders et al, Kivba, 
Larsson et al, and Shimbara also do not disclose wherein said marking controller 
automatically assigns at least one location of at least one of the flaws to at least one of 
the marking heads according to design data for the object, said marking controller 
controls the displacement devices to position said at least one of said marking heads at 
said at least one location of said at least one flaw based on said design data related to 
the object and transmitted position data related to said at least one location of said at 
least one flaw and said marking controller determines a start path for the marking 
device from said design data related to the object, from position data and from 
previously-defined, permissible areas of movement of the marking device. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 

Contact Information 
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3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JOHN H. LE whose telephone number is (571) 272- 
2275. The examiner can normally be reached on 9:00 - 5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Drew A. Dunn can be reached on (571) 272-2312. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/John H Le/ 

Primary Examiner, Art Unit 2863 
November 17, 2008 



